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1.  Introductibn 


'J  Much  research  has  j^itered  on  the  probleni  of  liiuluif;  siiortest  i^ths  in  graphs//lt  is  well 


known  Hint  llio.rc  is  ^ <lirocL  corrospoiuioncc  boCwtH'ii  Ulin  angle-source  shortest-pdAs  problem 
!in<i  the  following  sippio  linear  prograintning  problem.  ■  /  / 

Let  S  be  a  sn  of  linear  inequalities  of  the  form  Zf  —  if  where  the  are  unknowns 

and  the  a^/ are  given  real  constants.  Determine  a  set  of  values  for  the  such  that  the 
inequalities  in  S  are  satisfied,  or  determine  that  no  such  values  exist. 

This  paper  considers  Ihe  mixed-integer  linejir  programming  variant,  of  this  problem  in  which  some 
(but  not  necessarily  all)  of  the  Zi  ar>)-f«^juir«Hl  to  be  integers.  The  problem  arises  in  the  context 
of  syttchronous  circuit  optimixation  [9],  but  it  has  applications  to  i’lCIlT  scheduling  and  VLSI 
layout  compaction  as  well.  - - 

llefore  formally  defining  the  inixed-inU^ger  programming  problem,  we  restate  the  linear  pro¬ 
gramming  problem  above  in  another  form. 

Problem  L.  Let  C  =  [V,E,a)  be  an  edge-weighted,  directed  graph,  where  V  =  {1,2,..., 

I  V|}  is  the  vertex  set,  the  setji  of  edges  is  a  subset  ofVxV,  and  for  each  edge  (i,j)  €  E  the 
edge  weight  Uij  is  a  real  number.  Find  a  vector  x  =  (zi ,  zj, . . .,  x^v\)  satisfying  the  constraint 
that 

Xj  —  z^  <  a,-y 


for  all  (t,j)  €  E,  or  determine  that  no  feasible  vector  exists. 

The  graph  C  is  called  a  constraint  graph  for  the  linear  programming  problem.  There  are 
three  advantages  in  adopting  a  graph  repr<!sentation  of  the  problem.  First,  an  adjacency-list 
reprc.scntation  (I,  p.  200)  of  the  constraint  graph  6’  is  more  economical  than,  for  example,  a 
linear  programming  tableau  or,  when  the  graph  Ims  relatively  few  edges,  a  matrix  of  the  o^y. 
Second,  Problem  L  frequently  arises  in  situations  that  arc  naturally  de.scribed  by  a  graph.  Finally, 
the  graph-theoretic  formulation  helps  in  understanding  the  algorithms  that  solve  this  kind  of 
problem. 

A  method  for  solving  Problem  L  was  di.scovcrcd  in  the  late  1950’s  by  Ford  and  llcllm.an  [8,  p. 
1\\.  Yen  {13]  gave  some  improvements  to  the  Mellman-Ford  algorithm  as  well  .as  a  cogent  an.alysis 
showing  th.at  its  running  time  is  0(1V|^).  This  bound  is  easily  improved  to  0(|V||/i|)  by  using 
an  .adjacency- list  representation  for  the  constr.aint  graph. 

The  Ucllman-Ford  algorithm  can  al.so  be  used  to  solve  the  integer  linear  programming  variant 
of  Problem  L,  in  which  all  the  z,  arc  required  to  be  integers.  If  the  edge  weights  a,-y  all  happen  to 
be  integers,  the  Heilman- l'"ord  algorithm  will  produce  integer  v«alucs  for  the  z^.  If  the  a,'y  arc  not 
integers,  however,  but  the  z,  arc  required  to  be  integers,  c.ach  edge  weight  a,y  m.ay  be  replaced 
by  without  affecting  the  .satisfiublity  of  the  inequalities. 

The  focus  of  this  paper  is  the  mixed-integer  variant  of  Problem  L. 

Problem  MI.  Let  G  —  {V,Vi,E,a)  be  a  edge-weighted,  directed  graph,  where  V  = 
{1, 2, . . .,  |F|}  is  the  vertex  set,  the  set  Vi  is  a  subset  ofV,  the  set  E  of  edges  is  a  subset 
ofV  X  V,  and  for  each  edge  (i,j)  ^  E  the  edge  weight  a^j  is  a  real  number.  Find  a  vector 
X  =  (zi,Z2,...,Z|v|)  satisfying  the  constraints  Oiat 

ly  —  Xi  <  a,y 

for  all  {i,j)  G  E  and  that  z,'  €  Z  for  all  i  €  V/,  or  determine  that  no  feasible  vector  exists. 
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Tlio  vector  x  =  {/i,  xa, . . . ,  X|v|)  is  called  a  solution  to  Rranh  6’,  and  if  grapli  C  lois  a  solution, 
we  s;iy  that  C  is  satisfiable.  When  it  is  clear  frotn  context,  wc  use  the  s;irnc  U!rininology  for 
I’roblein  L. 

In  addition,  we  shall  refer  to  the  vertices  in  Vj  iis  the  integer  vertices  of  C  and  the  vertices  in 
Vji  =  V  —  Vj  as  the  real  vertices  of  C.  Wc  also  partition  the  set  of  edges  into  two  sets  depending 
on  whether  the  vertex  at  tlic  head  of  the  edge  is  integer  or  real: 

This  paper  presents  two  algorithms  to  solve  l‘rohlem  Mi.  The  first,  which  runs  in  0(|K||V7||fc’|) 
time,  is  a  straightforward  extension  of  the  nellman-l'ord  algorithm.  The  second  is  more  .sophis* 
ticated  and  has  a  running  time  of  0(\V\\E\  +  |V'||i^/|  lg|i^|).  We  conjecture  that  the  OdKlI/l’l) 
running  time  achieved  hy  the  Mc'llman-hord  algorithm  for  the  pure  linear  programming  and  pure 
integer  programming  versions  of  the  problem  is  not  achievable  in  general  for  sparse  instances  of 
I'roblein  Ml. 

The  rcmainilcr  of  this  paper  is  organized  as  follows.  Section  2  reviews  the  ilellman-Ford 
algorithm.  Section  presents  a  simple  relaxation  algorithm  for  solving  Problem  Mi.  Section  \ 
discusses  three  techniipies  Dijkstra’s  algorithm,  reweighting,  and  Fibonacci  heaps  -which  arc 
used  in  Section  5  to  construct  an  asymptotically  cfricient  algorithm  for  Problem  Ml.  Wc  discuss 
applications  and  present  some  concluding  remarks  in  Section  6. 

2.  Shortest  paths  and  the  Bellman-Ford  algorithm 

This  section  reviews  how  the  Bellman-Ford  algorithm  solves  Problem  L.  Although  the  results 
of  this  section  arc  well  known  and  can  be  found  in  most  textbooks  on  combi nalorial  optimization 
(see,  for  example,  (8,  p.  7-1]),  wo  repeat  the  material  here  for  the  rca<ler’8  convenience. 

There  is  a  natural  correspondence  between  l*roblcni  L  and  the  grapii- theoretic  single-source 
shor test-paths  problem,  l^ct  C  =  (f'j,V,(i)  be  an  instance  of  Problem  L.  Suppose  that  for  each 
vertex  i  6  V,  there  is  a  path  to  i  from  vertex  1,  and  let  dj  be  the  weight  of  shortest  (Ictast-wcight) 
p.ath  from  vertex  1  to  vertex  i.  (At  the  end  of  the  section,  wc  shall  di.scuss  the  case  in  which  some 
vertices  are  not  reachable  from  vertex  1.)  Then  for  any  edge  [i,j)  6  E,  wc  have  dj  —  di  <  Oij 
since  the  edge  {i,j)  c;in  be  appended  to  a  shortest  path  from  vertex  I  to  vertex  i  to  produce  a 
path  from  vertex  1  to  vertex  j  of  weight  d,-  +  a,y.  Thus  the  shortest-path  weights  d  arc  a  solution 
to  C. 

Whenever  G  is  satisfiable,  there  arc  infinite  number  of  solutions.  For  example,  if  z  is  a  solution 
to  G,  then  uniformly  adding  any  constant  k  to  each  x,-  yichis  another  solution  y,  where  =  Zj+fc 
for  each  i  G  V.  The  a.s.signmcnt  x,-  <-  dj  gives  each  x,-  its  largest  pos.siblc  value  subject  to  the 
constraint  that  X|  =  0.  To  sec  this,  con.sidcr  any  p.ath  p  of  weight  d,  from  vertex  1  to  vertex  i. 
If  the  inequalities  as.sociatod  with  tiic  edges  of  p  arc  summed,  the  unknowns  associated  with  the 
intermediate  vertices  cancel  and  the  result  is  the  inequality  z,-  —  Zi  <  d,. 

Whenever  the  gr.aph  G  contains  some  cycle  c  whose  weight  is  negative,  the  shortest  path 
weight  from  vertex  I  to  any  vertex  i  on  cycle  c  is  undefined  because  the  weight  of  any  path 
to  vertex  t  can  be  diminished  by  appending  a  traversal  of  c.  in  this  case  the  graph  G  is  not 
satisfiable.  If  the  inequalities  .‘kssocinted  with  the  edges  of  c  are  summed,  all  the  unknowns  Zj 
cancel,  and  the  resulting  ineiiuality  asserts  that  0  is  lcs.<i  than  or  equal  to  the  weight  of  c,  which 
is  false. 
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The  I  Sol  I  man- Ford  al);orilhin,  whioh  is  given  below,  solves  IVoblem  b  by  linditig  Ihe  weight 
of  the  shortest  path  to  eaeh  vertex  from  vertex  I.  Hhould  the  graph  contain  a  negative- weight 
cycle,  the  algoritlun  reports  that  the  graph  is  unsatisliable  by  calling  the  procedure  Fail,  whose 
semantics  we  leave  iinspccined. 

Algorithm  BF  (Bellman-Ford  algorithm). 

HFl.  Z|*-0; 

IJI''2.  for  t  2  to  1^1  do  i,  ♦-  oo; 
lll'’;i.  for  ind  <—  1  to  1^1  —  1  do 
HK'I.  foreach  (t,j)  G  F  do 

RFS.  Xj  *-  min(2j,  Zj  -f  a»^); 

ISF6.  foreach  (i,j)  €  F  do 

HI''7.  if  Xj  >  I,  -I-  o,y  then  Fail; 

For  each  vertex  j  €  V ,  the  Hcllman-Ford  algorithm  iteratively  updates  the  weight  Zy  of  a 
tentative  shortest  path  from  vertex  1  to  vertex  j.  After  initialixation,  the  algorithm  makes  1F|  — 1 
pjisses  through  the  edges  in  and  re/ozea  each  e<lgc  (t,y)  by  computing  zy  ♦-  min(zy,z,-  +  aiy). 

A  simple  analysis  due  to  Yen  (13]  indicates  why  the  Bellman-Ford  algorithm  works.  The 
weight  Xj  converges  to  the  weight  dy  of  a  .shortest  path  from  vertex  1  to  vertex  j  if  the  edges  on 
the  path  are  relaxed  in  order  along  the  path.  The  seipiencc  of  edges  relaxed  by  the  Bcllinan-Ford 
algorithm  consists  of  |F|  —  I  copies  of  some  ordering  of  E,  and  therefore  conLiins  every  vertex- 
disjoint  path  as  a  subsequence.  If  there  arc  no  negative-weight  cycles  in  G,  then  every  shortest 
path  is  vertex  disjoint,  so  each  x,  converges  to  the  shortest-path  weight  di.  On  the  other  hand, 
if  there  is  a  negative-weight  cycle  in  the  graph,  the  algorithm  detects  this  condition  by  iterating 
once  more  through  all  edges  to  see  whether  any  of  the  inequalities  remain  unsatisfied. 

The  Bellman-Ford  algorithm  as  given  above  determines  the  weight  of  the  shortest  path  from 
vertex  1  to  each  vertex,  and  therefore  solves  Problem  I.,  whenever  all  vertices  of  G  are  reachable 
from  vertex  1.  Tfie  code  can  bo  adapted  to  solve  I’roblem  b  on  arbitrary  graphs  by  simply 
changing  the  initialixation  step  (lines  BFl  nF2).  In  particular,  if  each  z,-  is  a.ssigncd  a  finite 
initial  value  u^,  the  relaxation  in  lines  BF3-BF5  sets  each  Xi  to  its  maximum  value  subject  to  the 
constraints  that  zy  —  z,  <  a,y  for  each  edge  (i,  j)  €  F  and  that  z,-  <  tt,-  for  c.ach  vertex  i  €  V. 
Notice  that  whenever  the  constraint  graph  G  is  satisfiable,  it  is  satisliable  subject  to  the  additional 
constraints  x,  <  u,-.  Should  the  inequalities  be  incomsistent  becau.se  there  is  a  negative-weight 
cycles  in  the  graph,  the  relaxation  will  not  converge  to  a  .solution,  and  the  inconsistency  will  be 
detected  by  the  test  in  lines  BF6  BF?. 

3.  Simple  relaxation  algorithms  for  Problem  MI 

As  was  mentioned  in  the  introduction.  Problem  bO  can  be  .solved  directly  by  the  Bellman- 
Ford  algorithm  when  all  unknowns  are  real  (Problem  L)  and  when  all  unknowns  are  integer. 
The  combination  of  integer  and  real  unknown.s,  however,  seems  to  make  the  problem  harder. 
In  this  section,  we  g.ain  some  intuition  about  the  structure  of  Problem  Mi  by  introducing  two 
algorithms  that  solve  it  in  0(|F’||V/j|fi^|)  time  much  the  same  w.ay  ns  the  Bellman-Ford  algorithm 
solves  Problem  L.  The  asymptotically  ellicicnt  algorithm  in  Section  i  is  derived  from  the  second 
of  these  algorithms. 

A  natural  approach  to  solving  Problem  Ml  is  to  sec  whether  the  Bellm.in-Ford  relaxation 
appro.ach  can  be  made  to  work.  Since  we  have  both  integer  and  re:il  vertices  in  the  graph, 


Figure  1.  An  instjinci'  of  IVohIciii  Ml.  Iiilcgnr  vertices  {Vi  =  {I,"!})  arc 
shown  a.s  squares  and  real  vertices  as  circles. 

however,  we  must  iiuKlify  the  relaxation  .step  HFr*  in  the  Hellman-Korrl  algorithm  to  produce  an 
integer  value  whenever  j  is  an  integer  vertex  (line  Uli).  'Phis  approach  does  in  fact  work,  but 
it  recpiires  more  iterations  than  the  .simple  I  ltd  I  man- Ford  algorithm.  The  next  algorithm  solves 
I’roblem  Ml.  The  number  of  iterations  n  in  line  112  will  be  determined  in  the  analysis  following 
the  algorithm. 

Algorithm  R  (Relaxation). 

111.  foreach  i  £V  do  Xi  *—  0; 

112.  for  ind 1  to  n  do 

113.  foreach  {i,j)  ^  E  do 

R4.  begin 

R5.  Xj  min(iy,  x,  +  o„); 

R6.  if  j  €  Vi  then  xy  *-  [xyj; 

R7.  end; 

R8.  foreach  (t,  j)  ^  E  do 

R9.  if  Xj  >  Xj  -I-  o,y  then  Faii, 

In  order  to  determine  a  value  of  n  such  that  Algorithm  R  works,  we  introduce  the  notion  of 
a  reducing  path.  Let  p  be  a  path  starting  at  some  vertex  k,  and  suppose  that  x*  is  initially  set  to 
0  and  that  all  the  remaining  x,  are  initinlize<l  to  oo.  Suppose  the  edges  in  path  p  are  traversed 
in  order  starting  from  k,  and  e.ach  edge  {i,j)  along  the  path  is  relaxed  as  in  statements  R5-R6. 
If  each  relaxation  of  an  edge  (t,  j)  reduces  the  value  ly,  the  path  p  is  called  a  reducing  path. 

Whenever  a  sequence  of  edges  contains  all  reducing  paths  as  subsequences,  the  relaxation  of 
each  edge  in  the  sequence  in  order  yields  a  solution.  (The  proof  is  analogous  to  Yen’s  analyas 
[13]  of  the  llellman-Ford  algorithm.)  The  Ilellman-Ford  algorithm  solves  Problem  L  because  in  a 
satisfiable  graph  with  only  real  vertices,  each  vertex  occurs  at  most  once  on  any  single  reducing 
path.  (And  in  fact,  every  shortest  path  is  a  reducing  path.) 

When  some  unknowns  arc  integer  and  some  are  real,  however,  it  is  possible  for  a  reducing 
path  to  vi.sit  the  same  vertex  more  than  once,  even  if  the  graph  is  satisfiable.  For  example,  in  the 
graph  shown  in  Figure  1,  the  reducing  path  p  =  3— *2— ♦!— »2— ♦3-^4“*3— »2  visits  vertices 
2  and  3  three  times  each.  If  all  the  x,  arc  initially  set  to  0,  the  edges  of  p  must  be  relaxed  in 
their  order  along  the  path  to  achieve  convergence.  Moreover,  relaxing  the  entire  edge  set  in  some 
arbitrary  order  only  3  =  1^1  —  1  times  might  not  achieve  convergence.  Since  the  value  of  n  in 
line  112  must  be  at  least  the  maximum  number  of  edges  in  any  reducing  path,  the  value  |P|  —  1, 
which  was  used  in  Algorithm  HF,  will  not  siilfice. 


l•'o^lu^nl«ly,  reducing  pallis  2iro  never  very  long  in  salisHable  graplis  because  of  llie  Following 
leintna. 

Lemma  1.  Suppose  C  =  [V ,Vf,  is  satisfiable.  JJ p  is  a  reducing  path  in  G,  then 

1.  p  visits  no  integer  vertex  more  than  once,  and 

2.  p  never  visits'  the  same  real  vertex  twice  without  visiting  some  integer  vertex  in 

between. 

Proof.  IF  cither  condition  is  violated,  then  the  reducing  path  p  can  be  extended  indefinitely  by 
repeating  the  cycle  that  causes  violation.  | 

Lemma  F  allows  us  to  determine  a  value  For  n  in  line  112  oF  Algorithm  11  such  that  the  z 
converges  to  a  solution  whenever  C  is  satisfin:ble.  Any  reducing  path  contains  each  integer  vertex 
at  most  once  and  each  real  vertex  at  most  |V/|  +  1  times.  Since  the  number  oF  edges  in  a  path  is 

one  less  than  the  number  oF  vertices,  any  rcdiicmg  path  For  a  satisfiable  graph  can  have  no  more 

than  IV'/I  +  (iV/t  +  1)|Kr1  —  1  =  lV'/||Vft|  +  jV'l  —  1  edges.  Thus  the  limit  n  oF  the  outer  loop  in 
Algorithm  11  should  be  set  to  |V';||V'/j|  +  (V'l  —  t.  The  ovcrsill  running  time  oF  Algorithm  II  is  thus 

o(lv/llv,ll/!;i). 

This  analysis  suggests  the  Following  iilgorithin  which  is  slightly  more  cflicient  than  Algorithm 
R,  and  which  Fortns  the  basis  oF  the  asymptotically  efiicient  algorithm  presented  in  the  next 
section. 

Algorithm  M  (Modified  relaxation). 

Ml.  foreach  i  Ao  z,-  ^  0; 

M2.  for  ind  *-  1  to  |Vr|  do 

M3.  foreach  (i,j)  €  Er  do 

Ml .  z,  <-  tni  n  (zy ,  z,-  +  a,y ); 

M5.  for  ind2  *—  1  to  \Vt\  do 

M6.  begin 

M7.  foreach  {i,j)  €  Ei  do 

M8.  Xj  *-  min(zy,  [z,  +  OiyJ); 

M9.  for  ind  1  to  |Vr|  do 

MlO.  foreach  [i,j)  €  Er  do 

Ml  1.  Xj  min(zj,  Xi  +  o<,); 

M12.  end; 

M13.  foreach  {i,j)  €  ^  do 

MIL  if  zy  >  z,  +  a,y  then  Fail’, 

The  only  dilTcrcncc  between  this  algorithm  and  Algorithm  R  is  that  it  treats  the  edges  in  Ej 
separately  From  the  edges  in  Kr.  In  lines  M7  M8  oF  Algorithm  M,  each  wige  in  /?/  is  relaxed  once. 
There  arc  (V/|  such  pjis.scs  over  Ei  which  arc  preceded.  Followed,  atid  separated  by  exhaustive 
relaxations  oF  the  edges  in  ICr  (lines  M2  Mi  and  M9  Ml  1).  In  each  exhaustive  rciax.ation  oF  Er, 
edges  arc  relaxed  until  no  Further  changes  in  the  values  oF  Zy  arc  po.ssible  For  j  G  Vr.  (Actually, 
the  relaxations  in  lines  M2  Mi  and  M9  Mil  arc  only  guaranteed  to  be  exhaustive  iF  there  are 
no  negative-weight  cycles  in  Er.  IF  there  arc  cycles  oF  negative  weight,  however,  this  condition 
is  detected  at  the  end  by  the  convergence  test  in  linos  MIS  Mli.) 


4.  Dijkstra’s  algorithm  and  rewcighting 

Scclion  r)-piivos  ;v  tiiorr  rllicK'nl.  iilgorilhm  U)  solve  Problem  Ml  Uiaii  either  Algorithm  11  or 
Algorithm  M.  'I'hree  iiiniortaHt  toeluruiues  are.  used  in  tlu*  algorithm.  The  (irst  is  Dijkslra’s 
algorithm  which  liiids  shortest  jiaths  in  a  graph  iVom  a  single  source  in  the  ca.se  when  all  the  edge 
weights  are  nonnegativc.  The  second  is  reweighting,  which  is  a  tochni<]U(!  due  to  ICdmonds  and 
Karp  [;j]  and  u.sed  by  Johnson  [7]  in  his  ellicient  algorithm  for  .solving  the  all-pairs  shortest-paths 
problem.  The  third  is  the  Fibonacci  heap  data  structure  <lue  to  Kredman  and  'I'arjan  [J],  which 
is  ati  improved  priority  queue  that  makes  Dijkstra’s  algorithm  run  in  time  (){\li\  +  |P|lg|P(). 

Given  a  graph  (7  =  (V,ti,a)  such  that  all  edge  weights  a,y  are  nonnegativc,  Dijkstra’s 
algorithm  computes  for  each  vertex  i,  the  weight  d,  of  the  shortest  path  from  vertex  1.  Ikcause 
eacli  edge  is  r<Jaxe<l  (!xactly  once,  this  algorithm  is  faster  than  the  nellman-l'’ord  algorithm  which 
solves  the  same  probletti  for  arbitrary  edge  weights.  Dijkstra’s  algorithm  derives  its  elliciency  from 
the  observation  th:it  along  any  shortest  path  from  vertex  I,  the  shortest-path  weights  d,-  form  a 
nondecreasing  sequence  if  ail  the  e«lge  weigiits  are  nonnegative.  Thus,  a  sequence  consisting  of  all 
edges  {i,j)  €  I'i  in  nomiecrca.sing  order  of  the  distances  d,  contains  as  subse<iuenccs  shortest  paths 
from  vertex  I  to  all  vertices  in  V .  l'’urthermore,  such  a  se(]uence  of  edges  can  be  computed  on 
llie  Ily  u.sing  a  priority  queue.  {The  textbook  jl)  gives  a  proof  of  correctne.ss  for  this  algorithm.) 

Algorithm  D  (Dijkstra’s  algorithm). 

Dl.  Z)  ♦-  0; 

1)2.  for  I  «—  2  to  |K|  do  z*  oo; 

1)3.  Q^V; 

Dl.  while  Q  <ll  do 

D5.  begin 

D6.  Choose  i  €  Q  such  that  Xi  =  minygQ  z,; 

D7.  Q^Q-  {«}; 

D8.  foreach  j  E  Vn  such  that  (i,j)  €  do 

1)9.  Zj  <-  min(zy,Zi  +  aiy); 

DIO.  end; 

If  the  .set  Q  in  the  .algorithm  is  implemented  as  a  standard  priority  queue,  each  extraction 
(lines  1)6  1)7)  and  update  (line  D9)  costs  0{lg|f,)|)  =  0(lg|P|)  time.  Thus  the  total  running 
time  of  Dijkstra’s  algorithm  is  0{|/i| Ig  jV)).  Kredrnan  and  Tarjan  (l)  describe  a  data  structure 
called  I’ibon.acci  heaps  that  supports  arbitrary  deletion  in  O(lgn)  amortized  time  and  all  other 
standard  priority  queue  operations  (including  update)  in  constant  amortized  lime.  Ily  using  a 
Fil)onacci  heap  in  Dijkstra’s  algorithm,  they  show  that  the  performance  can  be  improved  to 
0(|/-;|  +  lP|ig|k|). 

Since  Dijkstra’s  algorithm  is  equivalent  to  the  llellman-Ford  algorithm  on  graphs  with  non¬ 
negativc  edge  weights,  it  can  be  used  to  solve  I'roblem  L  on  such  graphs.  This  is  not  very 
interesting  in  itself,  .since  any  graph  C  =  [V,/i,a)  in  which  all  edge  weights  arc  nonnegative 
can  be  trivially  satisfied  by  setting  z,  to  0  for  each  i  €  V.  Our  interest  in  Dijkstra's  algorithm 
comes  from  a  stronger  property  of  the  .solutions  it  finds.  Suppo.se  the  initialization  step  (lines 
1)1  1)2)  is  changed  .so  that  each  variable  z,  is  initialized  to  a  finite  value  u,.  Then  the  relaxation 
procedure  in  lines  1)3  DIO  will  set  each  z,  to  its  largest  po.s.sible  value  consistent  with  the  con¬ 
straints  that  Xj  —  Xi  <  Oij  for  each  edge  (i,j)  €  1C  and  that  Xj  <  u,  for  each  vertex  t  €  V.  In 
other  word.s,  lines  1)3  DIO  of  Dijkstra’s  algorithm  arc  functionally  e(iuivalent  to  lines  I1F3  HF5 


of  Iho  Mclltnan-I'ord  alK<>rillirn  |>ruvi<l('(l  Lliat  all  tlu;  o<lgp  woighl.s  aij  arc  tiotincgaUvc.  Since  a 
graph  with  only  nonn(?gal.i\c  edge  weights  can  ticv<rr  contain  a  ncgativcvwcight  cycle,  no  test  for 
convergence  is  necessary  in  this  case. 

The  ellicient  algorithm  we  shall  present  to  solve  Problem  Ml  is  a  modilication  of  Algorithm 
M.  Notice  that  lines  M9  Ml  I  of  Algorithm  M  exhaustively  relax  the  edges  in  /!««  in  a  manner 
similar  to  lines  Ml''.‘l  ni'’ri  of  the  llellman-l'ord  algorithm.  In  Algorithm  M,  however,  this  code  is 
executed  many  times.  The  ellicient  algorithm  to  solve  Probhun  Ml  u.ses  a  trick  to  repl.-ice  this 
code  with  code  basi'd  on  the  more  ellicient  relaxation  procedure  in  lines  1)3-1)10  of  Dijkstra’s 
algorithm.  This  trick  is  the  trchniipie  of  reweighling  dw.  to  lOdmonds  and  Karp  [3]. 

Lemma  2.  Let  C  —  (T, /i, «)  be  an  edge-weighted  graph,  for  each  i  £  V  let  Ti  be  a  real 
number,  and  let  //  —  \  V,li,b)  where  h^j  =  aij  +  r j  —  rj  for  each  edge  (i,j)  £  /i.  For  each 
vertex  i  £  V  let  z,  be  a  real  number  and  let  yi  —  z,  —  fj.  Then  Xj  —  z,  <  for  all  (i, 7)6  IC 
if  and  only  if  yj  —  yi  <  bij  for  all  {i,j)  £  li  (that  is,  x  is  a  solution  to  (,'  if  and  only  if  y  is 
a  solution  to  U .) 

Proof.  Trivial.  | 

Wc  call  the  vector  r  =  (ri,r2,..  .,r|y|)  a  reweighting  of  the  graph  G. 

5.  An  asymptotically  efficient  algorithm  for  solving  Problem  MI 

This  section  shows  how  Dijkstra’s  algorithm  and  reweighting  can  be  incorporated  into  Algo¬ 
rithm  M  to  yield  a  faster  algorithm  for  solving  Problem  Ml.  Given  a  graph  G  =  (P,  P/,  1C, a),  the 
idea  is  to  find  a  reweighting  r  such  that  the  reweighted  graph  II  =  (P,  P/,  IC,b)  has  edge  weights 
bij  =  Oij  -t-  r,  -  ry  >  0  for  all  edges  (i,j)  £  JCn-  Demina  2  guarantees  that  6’  is  .satisfiable  if  and 
only  if  II  is  .satisfiable  and  also  that  a  solution  y  to  II  can  be  converted  into  a  solution  z  to  (7  by 
setting  z,  =  iji-\-ri  for  each  t  £  P.  The  advantage  gained  by  transforming  the  problem  on  G  to 
a  problem  on  II  is  that  the  relaxation  portion  of  Dijkstra’s  algorithm  (lines  1)3  1)10)  can  replace 
the  Dcllman-Ford  relaxation  (lines  M9  Mil),  which  is  the  most  expensive  part  of  Algorithm  M. 

The  (irst  .st.age  of  the  algorithm  is  to  determine  the  reweighting  values  r,  for  all  t  £  P  and 
the  new  edge  weights  6,y  =  a,  -1-  r,  —  ry  for  .all  (i,j)  £  E.  We  must  choose  the  values  r,-  such 
tliat  bij  >  0  for  all  (1,7)  £  Er.  Since  this  is  equivalent  to  requiring  that  ry  -  r,  <  o,y  for  all 
(1,7)  G  Er,  values  for  the  r,  can  be  found  by  applying  the  Hellman-Ford  algorithm  to  the  graph 
(V,ER,a}.  The  first  few  lines  of  the  algorithm  arc: 

Algorithm  T  (Efficient  algorithm). 

Tl.  for  i  €  P  do  ri  0; 

T2.  for  ind  1  to  |Pn(  do 
T3.  for  (1,7)  £  Er  do 

TL  ry +- min(ry,r,- -f  a,y); 

T5.  for  (f ,  7)  £ /?R  do 

TG.  if  ry  >  Ti  +  Oij  then  Fail 

T7.  for  (^,7)£/^  do 

T8.  bij  a,y  -1-  Ti  -  Tj] 

If  Uie  algorithm  fails  in  line  TG,  then  there  is  a  cycle  of  negative  weight  among  the  edges  in 
Er,  and  hence  graph  (!  is  un.satisliable  even  in  the  absense  of  integer  constraiiiLs.  Otherwise,  the 
values  b,j  computed  in  line  T8  arc  nonnegative  for  all  (1,7)  £  Er. 


The  next  stage  of  Algorithm  T  is  to  solve  the  mixed-integer  problem  on  the  graph  //  = 
(V',  Vi,l'j,b).  The  algorithm  alternately  performs  single  relaxation  passes  on  the  edges  in  /i'/  and 
exhaustive  relaxations  of  the  edges  in  Eji,  as  in  Algorithm  M.  We  begin  by  initialising  the  values 
yi,  which  will  converge  to  a  solution  to  II  if  II  is  siilisfiablc. 

T9,  for  i  E  V  do  y^  ^  0; 

This  initialization  has  the  added  fortune  of  .subsuming  the  first  exhaustive  relaxation  of  En  (lines 
M2  M'l  in  Algorithm  M).  After  the  execution  of  line  T9  we  have  yy  —  y,  =  0  —  0  <  for  all 
(i,j)  £  Er,  which  means  that  the  edges  in  Er  arc  already  exhaustively  relaxed. 

The  next  portion  of  Algorithm  T  parallels  lines  M5-M12  of  Algorithm  M  and  is  where  most 
of  the  computing  gets  done. 

TIO.  for  ind  *—  I  to  jV/l  do 

'r  1 1 .  begin 

TI2.  for  {i,j)  €  El  do 

T13.  yy  ^  min(yy,  [y,  -f-  6.yJ); 

TM.  Q^V] 

T15.  ■while  Q  ^  0  do 

T16.  begin 

TI7.  Choose  i£  Q  such  that  y,-  =  miny^Q yy; 

T18.  Q^Q-{i}; 

T19.  for  j  6  Vr  such  that  {i,j)  6  Er  do 

T20.  yy  ♦- min(yy,y, -1-biy); 

T21.  end; 

T22.  end; 

This  code  solves  the  problem  on  graph  II  in  almost  exactly  the  same  way  that  Algorithm  M 
would,  'riie  only  dilference  is  the  method  by  which  the  edges  of  Er  arc  exhaustively  relaxed. 
Whereas  lines  M9  .Mil  of  Algorithm  M  perform  the  exhaustive  relaxation  using  the  Bcllman- 
Kord  algorithm,  lines  TM  T21  of  Algorithm  T  take  advantage  of  the  nonneg.ativity  of  the  6,y  for 
(i,  j)  €  Ak  and  use  Dijkstra’s  algorithm. 

The  final  part  of  Algorithm  T  is  to  check  the  convergence  of  the  y  and  to  apply  Lemma  2  to 
produce  a  .satisfying  assignment  x  for  the  original  graph  G. 

T23.  for  (t',»  G  f?/ do 

T21.  if  yj  >  y,  -f-  b,y  then  Fail', 

T2r».  for  (t,j)  G  E  do 

T26.  I,  y,  -1-  r,-; 

Lines  T23  T24  check  the  convergence  of  y  by  testing  the  inequalities  associated  with  the  edges 
in  A'/.  The  inequalities  resulting  from  edges  in  Er  need  not  be  checked  because  the  relaxation 
in  lines  TM  T22  is  guaranteed  to  be  exhaustive.  (If  there  were  negative- weight  cyclc.s  in  Er,  we 
would  have  detected  this  in  lines  T5-T6.) 

Lim's  'r25  T2G  convert  the  solution  y  to  graph  II  into  a  solution  x  to  graph  G,  I^cmma  2 
efisures  that  the  inequalities  xy  —  z,  <  Ojy  are  satisfied,  but  wo  must  also  show  that  the  ij  are 
integers  for  all  i  G  V/-  I'or  each  i  G  k'/  the  value  y,  is  an  integer,  however,  and  furthermore,  the 
values  of  the  r,  produced  in  lines  Tl-TI  arc  zero  for  all  i  G  Vj.  Thus  for  :ill  the  integer  vertices, 
the  X,  are  integers. 

In  summary,  we  have  proved  the  following  theorem. 


Theorem  3.  Algorilkm  T  solves  Problem  MI. 

The  running  Ume  oF  Algorillim  T  is  0{|V||/4’|  +  1^||V^/|Ik|^^|)i  iT  i-iH-  priority  quouc  is  implc- 
monlcd  using  a  l''ibonac''i  heap. 

6.  Applications,  extensions,  and  conclusions 

The  soiiiliun  to  I’robletii  Ml  was  deinandecl  by  a  problem  coneerning  optimixation  of  sychronous 
circuitry  by  retiming  [9],  This  section  briclly  describes  two  other  problems  compaction  of 
VLSI  circuits  in  the  prt'sence  of  power  and  ground  buses  and  IMCllT  scheduling  with  periodic 
constraints  which  can  be  reduced  to  Problem  Ml.  We  akso  consider  an  extension  of  Problem  MI 
where  multiple  cla.sses  of  periodic  constraints  must  be  .satisfied.  (Pur  example,  some  of  the  Xi  arc 
rc((uircd  to  be  integers,  and  others  to  be  exact  multiples  of  an  integer  constant  c.) 

Circuit  compaction 

Optimal  (one-dimensional)  cotnpaction  of  VLSI  circuit  layouts  [r>]  is  another  application  of  the 
liellman-Pord  algorithm.  ICach  layout  feature  is  given  a  variable  representing  an  z-cuordiiiate, 
and  the  design  rules  are  enforced  using  constraints  of  the  form  i,  —  z,  <  a,y.  It  may  be  desirable, 
however,  to  allow  feature  t  to  be  to  the  left  of  feature  j  or  vice  versa,  but  not  to  allow  them 
to  occupy  the  satne  position.  Unfortunately,  if  one  wishes  to  allow  this  kind  of  transpo.sition  of 
layout  features,  either  optimality  or  performance  must  be  sacrificed  because  the  problem  becomes 
NP-completc  [10].  Hut  for  certain  compaction  problems  arising  in  practice,  transposition  of  layout 
features  can  be  allowed. 

Some  design  methodologies  enforce  the  placement  of  power,  ground,  and  clock  to  be  at  regular 
intervals.  For  example,  one  sign.il  processing  system  [11]  requires  that  these  wires  be  repeated 
every  200X,  and  that  the  width  of  all  cells  in  the  system  be  integer  multiples  of  this  distance. 
The  designer  is  then  constrained  to  build  a  now  cell  .so  that  the  layout  features  are  tightly  packed 
among  the  global  wires.  In  this  context,  where  some  layout  features  may  go  on  one  side  or  the 
other  of  some  global  wire  but  may  not  overlap,  the  compaction  problem  can  be  formulated  as 
Problem  MI. 

PERT  scheduling 

Suppose  we  have  a  constraint  graph  with  vertices  representing  milestones  in  a  project,  and 
edge-weights  indicating  the  timing  constraints  between  milestones.  Generally,  the  Bellman-Ford 
algorithm  can  be  used  to  provide  an  optimal  scheduling  of  the  mileslonc.s.  If  a  work  day  is  from 
9:00  a.m.  to  5:00  p.m.,  however,  we  may  not  wish  to  schedule  a  one-hour  job  to  start  at  4:30 
p.m.  Advancing  the  job  to  the  next  day  may  cause  an  e.'irlier  job  to  be  advanced  as  well  if  the 
two  jobs  are  constrained  to  f.'ill  near  each  other.  The  problem  of  PLUT  scheduling  with  periodic 
constraints  can  be  cast  .is  Problem  MI. 

Intuitively,  the  mixed-integer  formulation  allows  one  to  include  for  each  job  (1)  a  real  variable 
representing  the  starting  time  of  the  job,  ,ind  (2)  an  integer  variable  repre.senting,  say,  noon  on 
the  d.iy  the  job  occurs.  Thus  one  can  include  constraints  which  say,  for  example,  “This  job  must 
start  before  4:00  p.m.  on  the  day  it  occurs.” 

Multiple  periodic  constraints 

Suppo.se  that  in  the  PKRT  scheduling  applic.ition  mentioned  .above,  we  also  wish  to  take  into 
cnn.sideration  constr.iints  involving  weokend.s.  To  do  this,  we  would  as.sociatc  with  n.ich  job  a 
third  variable  representing,  s.iy,  Sund.iy  noon  of  the  week  during  which  the  job  occurs.  We 


arc  then  required  to  solve  a  variant  of  I'robleni  Ml  iti  which  there  are  two  class<'s  of  periodic 
constraints  some  variables  are  retjuired  U)  be  exact  integers  and  others  to  be  exact  multiples  of 
7  while  the  remaimier  may  have  arbitrary  real  values. 

The  solution  to  this  problem  is  based  on  the  following  algorithm  for  solving  I’roblerii  MI.  (We 
aswume  without  loss  of  generality  that  O  =  (V,Vj,IC,a)  is  .strongly  connected). 

Algorithm  U 

Ul.  if  (K,  Ii,a)  contains  a  negative- weight  cycle  then  l<'ail 
else  foreach  (i,  j)  £  Vi  X  Vi  do 

bij  <—  [the  le:ist  path  weight  from  t  to  j  m{v,rc,a)y, 

U2.  if  (Vj,  Vj  X  Vj,b)  contains  a  negative- weight  cycle  then  Fail 

else  find  an  integer  assignrTient  x  on  Vi  such  that  ly  -  i,  <  for  all  i,j  £  Vj; 

IJ3.  Apply  the  Hellman-Kord  algorithm  to  (V', /i’yf.n)  using  the  i,  found  in  Step  IJ2  as 
initial  values  for  the  integer  vertices  and  inlinite  initial  values  for  the  real  vertices; 

Step  IJi  produces  a  graph  II  =  {Vr,Vj  X  Vj,b)  which  is  feasible  if  and  only  if  G  is  feasible, 
Step  IJ2  solves  II  if  II  is  feasible,  and  Step  IJ3  extends  the  solution  from  the  set  Vj  of  integer 
vertices  to  the  entire  vertex  set  V.  Step  Ul  can  be  performed  iti  0(|V'1‘‘)  time  by  the  Kloyd- 
Warshall  algorithm  [8]  or  in  0{\V\\E\  -I-  iV/llVj  Ig It'D  time  by  Fredman  and  Tarjan’s  improved 
version  [4]  of  Johnson's  algorithm  [7].  Step  U2  can  be  performed  by  the  nellinan-Ford  algorithm 
and  takes  time  0(|V7|^)  because  //  is  a  complete  graph.  The  cost  of  Step  Ul  dominates  the  cost 
of  Step  U3,  which  takes  only  0{\V\\E[i\)  time. 

Algorithm  U  extends  naturally  to  the  case  in  which  there  are  multiple  classes  of  periodic 
constraints,  provided  that  each  period  (e.j.,  I  week)  is  an  exact  multiple  of  the  next  smaller 
period  {e-g.,  1  day).  First,  Step  Ul  is  applied  (with  an  appropriate  scaling  of  the  e<lgc  weights) 
to  produce  an  equivalent  problem  in  which  the  most  loosely  constrainoil  class  of  vertices  in  the 
original  problem  is  eliminated  from  consideration.  This  new  problem  is  then  solved  recursively 
(or  by  direct  application  of  Algorithm  T  if  only  two  classes  of  vertices  remain).  Finally,  the 
solution  is  extended  to  the  entire  set  of  vertices,  as  in  Step  U3. 
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